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Method and device to identify a periodic light source £pO - DG» 1 

This invention relates generally to devices for location positioning and more 
particularly relates to a method for identifying an environmental source emitting a base 
frequency and waveform signal. 

The present invention also relates to a system for performing the method and a 
computer program for performing the method. 



In various modem applications, it is essential for a device to know its location. 
Usually it suffices to know the room in which the device is located. This allows the 
application to be tailored to the location of a user of the device. This way, a so-called 
context-aware device is capable of adjusting its operations to fit the context in which the 
device is introduced. Context is any information that can be used to characterize the situation 
of an entity. An entity is a person, place, or object that is considered relevant to the 
interaction between a user and an application, including the user and application themselves. 
Almost any information available at the time of an interaction can be seen as context 
information. Some examples are: 

• spatial information - e.g. location, orientation, speed, and acceleration 

• environmental information - e.g. temperature, air pressure, light, and noise level 

• resources that are nearby - e.g. accessible devices, and hosts 

• availability of resources - e.g. battery, display, network, and bandwidth 

• physiological measurements - e.g. blood pressure, heart rate, respiration rate, and 
muscle activity. 

A system is context-aware if it can extract, interpret and use context 
information and adapt its functionality to the current context of use. The challenge for such 
systems lies in the complexity of capturing, representing and processing contextual data. 
To capture context information generally some additional sensors and/or programs are 
required. To transfer the context information to applications and for different applications to 
be able to use the same context information a common representation format for such 
information should exist. In addition to being able to obtain the context-information, 
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applications must include some "intelligence 11 to process the information and to deduce the 
me anin g. This is probably the most challenging issue, since context is often indirect or 
deducible by combining different pieces of context information. E.g. if three persons meet in 
a certain office room at a certain time, it can mean that it is the weekly strategy meeting. 
5 Another situation would be when a context-aware application, such as a context-aware 
mobile phone, is placed in front of the user's personal computer at work, the application 
could then be given the information that the user do not wish to be disturbed with private 
phone calls. 

There are features that are characteristic for context-aware applications. 

10 Firstly, information and services can be presented to the user according to the current context. 
This includes the selection of proximate information and services, and contextual commands. 
Secondly, automatic execution of a service may be performed when being in a certain 
context. This includes context-triggered actions and contextual adaptation. An example of the 
previous would be that when a user enters a specific room her mails would be shown on a 

15 nearby terminal. An example of the latter would be the change on volume on a phone 
according to a current noise level. 

A very evident type of application is the ability to find nearby resources. This 
can include input and output devices: printers, displays, speakers, facsimiles, video cameras, 
thermostats, etc. In pure service lookup actually even no location information needs to be 

20 used. In situations where e.g. distance calculations have to be done location information of a 
device is required. 

The usage of context information is still quite limited since it is very 
challenging and complex to capture, represent, and process contextual data. The most used 
types of context information are location, identity and time information. The context-aware 

25 application development is mainly concentrated around user interfaces, virtual and . 
augmented reality, mobile, handheld and wearable computing. There are very few 
commercial products using context information yet, because of the challenges in this field. 

There are several ways to obtain required location information. A variety of 
tracking systems exists, some of them based on the Global Positioning System (GPS) with 

30 which the location of a device can be determined. Systems for a positioning network such as 
the GPS is known for the purpose to locate virtually any place on the planet, however, such 
tracking systems are quite expensive which makes them unacceptable for low-cost consumer 
electronics. Other solutions involve the installation of positioning devices such as GSM, 
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DECT or Bluetooth beacons, etc. Furthermore it is known to adapt existing devices to act as 
sources of position information. 

A lighting source can be modified to operate at a specific known frequency, 
which can be detected by a device and translated to a location. US 5,657,145 discloses a 
5 method of transmitting coded data signals by modulating the output from light sources, e.g. 
electric lamps. The visible light wave is used as a carrier wave whereon the signals are 
transmitted. A wide range of digital information can be transmitted such as audio and video 
content, etc. Of course, this modulation can also be used to identify the light source. 

However, the light sources have to be modified to transmit the requested 
10 information and thereby be identified. It will though be advantageous not to modify ambient 
light sources for several reasons. 



It is an object of the invention to provide a method for location positioning of 

15 a device without the need for modifying environmental sources. 

By omitting environmental source modifications, a positioning device 
according to the present invention may be more consumer-oriented, cause the lack of 
operational precautions. It may therefore be possible to quickly adapt a device according to 
the method of the present invention to a new environment without the need of installing 

20 sophisticated hardware. Therefore, the method of the present invention deals with 

recognizing environmental sources by their natural signal pattern without introducing a new 
pattern by artificial modulation. 

It is further an object of the invention to provide a method for storing location 
parameters, which may be recovered for further processing. 

25 This is achieved by a method (and corresponding device) for identifying an 

environmental source emitting a base frequency and waveform signal, the method comprising 
the steps of measuring the waveform signal of the source in a predetermined time-interval; 
estimating a the emitted waveform characteristic of the measured waveform signal; and 
determining a number of actions based on the estimated characteristic. 

30 Further, the method according to the present invention proposes to identify a 

"fingerprint" of an environmental source, e.g. a light source, and to store this fingerprint, 
which in an embodiment of the invention is a waveform of a light intensity, in memory. The 
fingerprint can then be used to e.g. determine that the device has been in a given location 
before by use of information affiliated with data of the fingerprint. The affiliated information 
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may be instructions to execute a number of actions, e.g. user notification, external device 
controlling, data acquisition, etc. If light sources are operating periodically i.e. a source is fed 
by AC-voltage, not only the light intensity may be measured, but also a light waveform 
characteristic history can be derived by means of signal processing. Thereby, the method 
5 according to the present invention may be used to keep continuously track of a light source. 
Incandescent illuminations can be distinguished from fluorescent and LED-based light etc. 
Moreover, the presence of a cathode ray tube can be detected and even distinguished by their 
characteristic refresh rate and phosphorescence. That is, no alterations of the light sources 
have to be performed. Thereby the needs of a positioning device according to the present 
1 0 invention may be reduced to make use of natural properties of environmental sources only. 



e.g. a fan emitting a characteristic humming sound or electromagnetic radiation descended 
from an electric motor or an alternator etc. 



15 the information may be associated to a number of waveform characteristics. The information 
may be any kind of data such as instructions, user input, data pointers, etc. A waveform 
characteristic may be defined to be a calculation based upon a frequency and a waveform of 
e.g. a sampled light source. The light characteristic may for example be a spectrum analyse 
representative of the sampled signal. If a processed signal is periodic, a base frequency may 

20 typically be found. The found base frequency (the lowest valid signal frequency which 
represents the interval between the spectral bands which can be computed from the 
waveforms) may have relevance by comparing a set of signals. By knowing the base 
frequency, more efficient signal detection algorithms may be adapted to perform a signal 
comparison. 

25 By performing autocorrelation on a periodic signal, any undesirable signals 

within may be suppressed. This is a well-known technique to suppress and sometime even 
eliminate undesirable noise to get a clean measurement signal. A further technique for 
cleaning a signal, i.e. noise cancellation, is by averaging a signal over a number of periods. 
Thereby, not only noise will be reduced, but also any potential sample errors during signal 

30 capturing such as jitter, timing errors, etc. may be reduced significantly or eliminated. When 
a light intensity characteristic is calculated, it may be altered in amplitude, e.g. normalized, 
re-sampled, stretched in time, etc. to achieve a uniform, storable and comparable 
characteristic stature. 



Environmental sources may moreover count apparatus emitting sonic signals, 



Information is stored in the device according to the present invention where 
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A base frequency of a digital sampled signal may be derived by use of Fast 
Fourier Transform (FFT), which is generally known to be a stable and efficient method, but 
other methods may alternatively be applied according to the type of sampled data* Since a 
FFT calculation sometimes do not output an accurately and acceptable result, in this case the 
5 base frequency, the FFT output may be refined by using a method comprising interpolation. 
This refinement typically increases reliability to an acceptable level of confidence. 

After deriving a valid light intensity characteristic, a sample-by-sample 
comparison of this and a unique characteristic may be performed. The estimated 
characteristic typically consists of an averaged period of a discrete waveform. For 
10 comparison of two signals, it is often useful that the signals are phase aligned. Therefore it 
may be advantageous to phase shift one of the signals to obtain phase synchronization. For 
this purpose a ring buffer may be used. By rotating the buffer a requested number of samples 
the two samples may be phase aligned. Thereby a direct and simple sample-by-sample 
comparison may be applied. The two waveforms may be compared with respect to an offset 
15 value and/or deviation magnitudes to accept a wider range of near identically waveforms. 

If an estimated waveform cannot be found acceptable identically for any 
already known stored waveform, it may be decided to accept greater deviations or, if 
necessary, to store the new and incomparable waveform as a new unique light intensity 
characteristic. Thereby the number of recognizable and separate light intensity characteristics 
20 may be increased for future processing tasks. 



These and other aspects of the invention will be apparent from and elucidated 
with reference to the embodiments described hereinafter in conjunction with the drawings, in 
25 which: 



Fig. 1 illustrates an embodiment of the current invention for waveform 
detection, signal conversion and signal processing. 
30 Fig. 2 shows a waveform of light emitted by an incandescent lamp provided 

with 50 Hz AC. 

Fig. 3 shows a waveform of light emitted by a fluorescent lamp provided with 

50 Hz AC. 



PHNL020974EPP 




6 07.10.2002 
Fig. 4 shows a waveform of light emitted by a computer monitor with 76 Hz 

refresh rate. 

Fig. 5 shows a waveform of light emitted by a computer monitor with 100 Hz 

refresh rate. 

5 Fig. 6 illustrates an embodiment of the current invention for light detection, 

signal conversion and signal processing with two independent light detection circuits. 



Fig. 1 illustrates an embodiment of the invention to identify an environmental 
10 source, in the following a light source. The phototransistor (101) is operated with a bias 

voltage by the pull-up resistor (106) in the linear region to pick up light emitted from ambient 
light sources. The phototransistor (101) output may be amplified (102) to feed the A/D- 
converter (103). The current measured by the ADC (103) may be proportional to the light 
intensity as long as the light is not too bright. The processing device (104) may carry out 
1 5 computations for a signal-processing algorithm described in the following. Since most 
artificial light sources typically have operating frequencies of a few hundred Hertz, it is 
typically sufficient to sample the signal in the ADC (103) at a few thousand Hz. The 
workload for the algorithm in the processing device (104) is therefore moderate since signals 
of interest have a relative low frequency. Thereby it is possible to make use of inexpensive 
20 components which further is preferred for consumer-oriented products. To obtain a 

characteristic for a signal, it may be useful to identify a base frequency of the signal and 
additionally a waveform thereof. The signal processing method in the DSP (104) used to 
derive a light intensity characteristic may therefore comprise the steps explained in the 
following. It is to be understood, that values in the following, such as the sample rate and 
25 sample length, etc. easily may be changed to fit a given embodiment. 

1) The input signal from the ADC may be a Pulse Code Modulated (PCM) signal sampled at 
8 kHz. The signal is partitioned into non-overlapping frames of N = 2048 samples. Each 
sample is multiplied with a Gaussian window function to minimize spectral leakage. A 
Fast Fourier Transformation (FFT) is computed on the frame resulting in N spectral 
30 coefficients. Low and high frequency components (<10 Hz, >7 kHz) are removed by e.g. 

a band pass filter since these parts of the signal do not contribute to the signal being 
recognized. The spectral coefficient of maximal power is located, which provides a 
coarse estimate of the base frequency. Thereby an indication of the expected frequency 
found in step 2 is to be found. 
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2) The same input signal as used in step 1 is used to improve the base frequency estimation. 
An estimation of the frequency corresponds to an estimation of the period, here in 
number of samples. For each potential period T in the confidence interval estimated in 
step 1, the average power of x[k] - x[k-T] is computed, where x[0], . . x[N-l] are the 

5 samples of the frame. The location T of the minimal power is located by e.g. second order 

interpolation. A frequency estimation like this is usually more accurate than a single 
sample interval by depending on choosing an appropriate size of the autocorrelation 
window. 

3) The accurate estimation of the signal period T is used to extract the waveform of the 

10 periodic signal. This is done by splitting the input signal into non-overlapping frames, the 

k-th frame starting at round (k*T). The frames are averaged with a first-order low-pass 
filter resulting in an estimated waveform and a confidence interval for each position of 
the waveform. The low-pass filter used in this example is defined as y[n] = (1-a) y[n-l] + 
a x[n], a = 0,1, It is important that step 2 returns a sub-sample accurate estimation of T, 

15 because otherwise the period would drift away and the averaging process would remove 

details of the waveform. By this averaging process unwanted noise e.g. flicker noise, 
thermal noise, etc. may be minimized to approach a cleaner signal, 

4) The final processing step is to rotate the waveform within the frame such that it is 
positioned in a fixed relation to the period. For example, if the waveform is just only one 

20 peak it should always appear at the same position. To find a fixed reference position 

within the waveform, the first non-DC coefficient of the FFT of the signal is calculated. 
The phase of this complex number indicates the phase-shift by which the waveform 
should be rotated back. The result of this method is a very stable waveform within the 
frame since is uses a global property of the waveform and not just a local feature such as 
25 the maximum. 

In a preferred embodiment of the present invention the algorithm reads a 8 
kHz linear PCM sampled signal as input and outputs an estimation of the dominant frequency 
and waveform of the most powerful periodic signal rate at about 4 Hz as the sampled signal 
is partitioned into non-overlapping frames of 2048 samples. 
30 The amplifier (102) may comprise means to avoid overloading of the ADC 

(103) by the input signal. If the received light is too intense the amplifier gain or e.g. a signal 
compressor may be adjusted to overcome this. Likewise, the sampled signal may be 
normalized in the DSP (104) upon signal comparison to preserve comparable amplitude 
levels. 
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The DSP (104) preferably comprises a memory (107) for storing a number of 
calculated light intensity characteristics. It may be possible for the DSP (104) to compare two 
signal characteristics with a range of allowed deviation among. In a preferred embodiment, 
the device further comprise means for recording, i.e. storing, a new calculated light 
5 characteristic, i.e. waveform. 

Fig. 2 shows a waveform of light emitted by an incandescent lamp provided 
with 50 Hz AC. Since the current provided oscillates with 50 Hz, the light modulation will be 
100 Hz with a near sinus-shaped waveform. If the sampling frequency is 8 kHz like the 
above-mentioned embodiment and the window sampling window is of a size of 2048 
10 samples, an averaging of the sampled signals may be applied by for example 10 periods, 
which is often plentiful for a valid signal approximation even in a heavily noised 
environment. Non-periodic signals such as random noise may thereby be virtually eliminated. 

Fig. 3 shows a waveform of light emitted by a fluorescent lamp provided with 
50 Hz AC. Likewise the incandescent lamp, the modulated light frequency will be around 
15 100 Hz but not smooth-curved in the same way as in figure 2, though. By sample-by-sample 
comparison of the sample waveforms for fig. 2 and fig. 3 respectively, a relative difference in 
the waveform shapes may be found. Thereby the DSP may conclude that the two light 
characteristics hardly origin from the same source of light. It may, however, be concluded 
that the two waveforms are acceptable identical if for example no shape of more identical 
20 waveforms are stored. It is to be understood that the selection threshold may vary according 
to stored information. 

Fig. 4 shows a waveform of light emitted by a computer monitor with 76 Hz 
refresh rate. The refresh frequency can be easily detected as a pulse which shape depends on 
the content of the display. Since the waveform length will be different from the 50 Hz 
25 supplied signals, a sample-by-sample comparison with the 76 Hz will not be necessary. By 
comparing the waveform lengths it will show that the signals belong to different categories 
(1 00 Hz and 76 Hz respectively). 

Fig. 5 shows a waveform of light emitted by a computer monitor with 100 Hz 
refresh rate. Again, first the sample length has to be compared with waveform lengths stored 
30 in memory. The monitor operating by 76 Hz may therefore not be categorized with the new 
100 Hz monitor signal, as the 76 Hz signal may be longer in number of samples. However, 
the waveforms in fig. 2 and fig. 3 may be categorized as possible identical waveforms in 
conjunction with the 100 Hz monitor signal. 
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Next step may be above-mentioned sample-by-sample comparison to unveil how closely the 
signals resemble. The comparing DSP algorithm may e.g. tolerate deviations of frequency, 
waveform data, etc. to compensate for measuring and/or calculation inaccuracies. 

Fig. 6 shows another embodiment of the present invention, wherein the DSP 
5 (104) processes inputs from the two light detecting circuits (108a, 108b) comprising pull-up 
resistor (106a, 106b), phototransistor (101a, 101b), amplifier (102a, 102b), and ADC (103a, 
103b). By using two or more inputs, the relative orientation of a device may be determined in 
contrast to the use of only one light sensor. For this it may be necessary to use detectors with 
different sensitivity characteristics. In contrast to a standard digital camera, this camera with 
10 just a few pixels is very fast in computing the direction and further, only sensitive to periodic 
light sources. A possible application for this is a pointing device that does not need a fixed 
reference as long as there are periodic light sources around. 

There are several applications for the method according to the present 
invention to identify a "fingerprint" of a periodic light source, some of them described in the 
15 following: 

• "Been here before": The identity of a light source provides information about the location 
of the light detector. In particular, mobile devices equipped with a detector can recognize 
that the user is now in a room where he or she has been before by inspecting the room 
lighting or CRT screen available. 

20 • "Remember this": As before, but the detector is explicitly trained to remember a certain - 
light source by pressing a 'record* -button. Then this source is uniquely identified among 
others. For example, a certain CRT can be found back again. Or the light source has been 
specifically designed as a 'beacon', e.g. an infrared LED sending out a fixed bitsequence 
repeated periodically. The mobile device remembers this particular signature as a . 

25 reference point. 

• "Orientation Sensor with arbitrary Reference Point": Since the method of this invention 
allows to identify an arbitrary periodic light source, it can be extended easily to locate the 
relative orientation of detector and light source. For this it may be necessary to have 
several detectors with different sensitivity characteristics. After the joint signal of the 

30 detectors is locked to a periodic light source, its direction-of-arrival can be computed 

from a comparison of the relative intensity for the detectors. In contrast to a standard 
digital camera, this 'camera with just a few pixels* is very fast in computing the direction 
and only sensitive to periodic light sources (natural or planted on purpose). A possible 
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application for this is a pointing device that does not need a fixed reference, as long as 
there are periodic light sources around. 

• "Suppress Periodic Interference": As a completely different application, the method of 
this invention can be used to suppress the main periodic signal from the signal coming 

5 from a light detector. For example, it is known that TL-lamps interfere with remote 

controls for consumer applications. 

This is usually solved by modulating the remote control at about 30 kHz and 
applying a band pass filter to the intensity signal. However, the power of the interference can 
be much larger than the communication signal. The method of this invention allows to 
10 predict the periodic interference and subtract it from the light signal to obtain a cleaner 
communication signal. It is even possible to use the predicted signal to adjust the 
preamplifier of the light detector to avoid overloading the detector. 

• "Quality Control for Lamps": Another different application is the quality control of 
lamps, either during fabrication or during use. Most common types of lamps produce 

15 periodic light where the details of the waveform are characteristic for properties of the 

actual source. 

For example, TL-lamps close to their end of life show a significantly higher 
amount of flicker and noise. In the development of this invention this deviation from nominal 
performance has shown clearly. Therefore it should be possible to use it for service and 
20 maintenance by detecting lamps that are likely to fail in the near future. Currently, we do not 
know the actual dependency of residual lifetime and light pattern. This is subject to further 
investigation if seen as promising. 

• "Triggering Digital Scopes": Yet another application involves the signal processing 
method of this invention, without the light sensor part. An important and difficult part of 

25 digital scopes (to show electric signals) is the generation of trigger impulses. The method 

of this invention allows producing stabile triggering for periodic signals. This is an 
extension to existing trigger methods based on local features of the signal like 'peak- 
trigger' etc. 

The uses of general-purpose microprocessors, instead of DSPs, are a viable 
30 option in some systems design. Although dedicated DSPs are well suited to handle signal- 
processing tasks in a system, most designs also require a microprocessor for other processing 
tasks such as route managing, etc. Integrating system functionality into one processor may be 
the best way to realize several common design objectives such as lowering the system part 
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count, reducing power consumption, minimizing size, and lowering cost, etc. Reducing the 
processor count to one also means fewer instruction sets and tool suites to be mastered. 

While the description above refers to particular embodiments of the present 
invention, it will be understood by someone skilled in the art that many of the details 
5 provided above are by way of example only, and modifications may be made without 
departing from the scope thereof. 

The accompanying claims are intended to cover such modifications as would 
fall within the true scope and spirit of the present invention. The disclosed embodiments are 
therefore to be considered in all respect as illustrative and not restrictive, the scope of the 
10 invention being indicated by the appended claims, rather than the foregoing description, and 
all changes come within the meaning and range of equivalency of the following claims are 
therefore intended to be embraced therein. 
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CLAIMS: fcP° 



8. 



1 . A method for identifying an environmental source emitting a base frequency 

and waveform signal, the method comprising the steps of: 

a) measuring the waveform signal of the source in a predetermined time-interval; 

b) estimating the emitted waveform characteristic of the measured waveform; 

c) determining a number of actions based on the estimated characteristic. 



2. A method according to claim 1, wherein the determined number of actions 
comprises comparison of the waveform characteristic with a unique waveform characteristic 
with affiliated information stored in a memory. 

10 

3. A method according to claim 2, wherein the affiliated information comprises 
location parameters. 

4. A method according to claim 1, wherein a fast Fourier transform derives the 
1 5 base frequency of the estimated waveform characteristic. 

5. A method according to claim 1, wherein undesired signals may be suppressed. 

6. A method according to claim 1, wherein the base frequency is refined by 

20 finding a maximum in an autocorrelation function of the estimated waveform characteristic. 

7. A method according to claim 1 , wherein the estimated waveform characteristic 
is computed by averaging a number of estimated waveform characteristics. 

25 8. A method according to claim 1 , wherein a phase shift is applied to the 

estimated waveform. 



9. A method according to claim 1 , wherein the determined action comprises 

storing of the estimated waveform characteristic as a unique waveform characteristic. 
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10. A method according to claim 1, wherein the method allows locating a relative 
orientation of a detector device and the environmental source by use of two or more emission 
detectors. 

5 

11. A method according to claim 1 , wherein the method may predict and 
suppresses a specific periodic signal, 

12. A method according to claim 1, wherein the environmental source is a source 
10 emitting light. 

13. A method according to claim 1, wherein the environmental source is a source 
emitting sonic signals. 

15 14. A method according to claim 1, wherein the environmental source is a source 

emitting electromagnetic signals. 

15. A method according to claim 1, wherein the environmental source is a source 
emitting mechanical movement signals. 

20 

16. A system for identifying an environmental source emitting abase frequency 
and waveform signal, the system comprising means for: 

a) measuring the waveform signal of the source in a predetermined time-interval; 

b) estimating the emitted waveform characteristic of the measured waveform; 
25 c) determining a number of actions based on the estimated characteristic. 

17. A system according to claim 16, wherein the determined number of actions 
comprises comparison of the waveform characteristic with a unique waveform characteristic 
with affiliated information stored in a memory. 

30 

18. A system according to claim 17, wherein the affiliated information comprises 
location parameters. 
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19. A computer readable medium containing a program for making a processor 

carry out the method of any of the claims 1 through 15. 
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ABSTRACT: 



This invention relates generally to devices for location positioning and more 
particularly relates to a system for identifying an environmental source emitting a base 
frequency and waveform signal. A sensor (101) records an environmental source (105) 
emitting abase frequency and waveform signal, the signal being amplified (102), digitized 
(103), processed and compared (104) with a stored unique waveform characteristic. On the 
basis of the comparison result(s), location positioning and/or a device orientation may be 
determined. The invention further relates to a method and a computer readable medium 
containing a program for making a processor carry out the method. 
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